UNDERSTANDING REPLICATION : CONFIDENCE INTERVALS , p VALUES , AND WHAT ’ S LIKELY TO HAPPEN NEXT TIME Geoff
نویسنده
چکیده
Science loves replication: We conclude an effect is real if we believe replications would also show the effect. It is therefore crucial to understand replication. However, there is strong evidence of severe, widespread misconception about p values and confidence intervals, two of the main statistical tools that guide us in deciding whether an observed effect is real. I propose we teach about replication directly. I describe three approaches: Via confidence intervals (What is the chance the original confidence interval will capture the mean of a repeat of the experiment?); Via p values (Given an initial p value, what is the distribution of p values for replications of the experiment?): and via Peter Killeen’s ‘prep,’ which is the average probability that a replication will give a result in the same direction. In each case I will demonstrate an interactive graphical simulation designed to make the tricky ideas of replication vividly accessible.
منابع مشابه
Confidence intervals and replication: where will the next mean fall?
Confidence intervals (CIs) give information about replication, but many researchers have misconceptions about this information. One problem is that the percentage of future replication means captured by a particular CI varies markedly, depending on where in relation to the population mean that CI falls. The authors investigated the distribution of this percentage for varsigma known and unknown,...
متن کاملReplication and p Intervals: p Values Predict the Future Only Vaguely, but Confidence Intervals Do Much Better.
Replication is fundamental to science, so statistical analysis should give information about replication. Because p values dominate statistical analysis in psychology, it is important to ask what p says about replication. The answer to this question is "Surprisingly little." In one simulation of 25 repetitions of a typical experiment, p varied from <.001 to .76, thus illustrating that p is a ve...
متن کاملStatistical and clinical significance, and how to use confidence intervals to help interpret both.
Statistical significance is a statement about the likelihood of findings being due to chance. Classical significance testing, with its reliance on p values, can only provide a dichotomous result - statistically significant, or not. Limiting interpretation of research results to p values means that researchers may either overestimate or underestimate the meaning of their results. Very often the ...
متن کاملConfidence intervals and p-values in clinical decision making.
UNLABELLED Clinical trials are usually performed on a sample of people drawn from the population of interest. The results of a trial are, therefore, estimates of what might happen if the treatment were to be given to the entire population of interest. Confidence intervals (CIs) provide a range of plausible values for a population parameter and give an idea about how precise the measured treatme...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2006